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(57) In a system for communicating an image, an im- 
age compression scheme is employed to encode the im- 
age to reduce the required bandwidth for transmitting 
same. For example, this compression scheme includes 
performing, on the image, a discrete cosine transform 
(DCT), followed by quantization. To reduce the effects 
of coding artifacts occasioned by the compression 
scheme, in accordance with the invention, a filter ar- 
rangement which is matched to the coding of the image 
may be utilized to process a received image. The filter 
arrangement is designed to truncate each non-zero fre- 
quency component in the received image whose ampli- 
tude is lower than a certain threshold; which is a function 
of the quantization step size used. 
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Description 

Field of the Invention 

[0001] The invention relates to communications sys- 
tems and methods, and more particularly to a system 
and method for video communications which imple- 
ments an image compression scheme. 

Background of the Invention 

[0002] In video communications, images are coded in 
accordance with an image compression scheme to re- 
duce the required bandwidth for transmitting the imag- 
es. In accordance with such well known image compres- 
sion standards as the MPEG, MPEG-2, motion-JPEG 
and JPEG standards, an image coding process typically 
includes performing a block based frequency transform, 
e.g., discrete cosine transform (DCT), on an image to 
be transmitted. The resulting DCT coefficients are quan- 
tized or mapped to different quantization steps to render 
an approximate representation thereof. If the available 
transmission bandwidth is relatively small, with respect 
to the complexity of the image to be transmitted, the size 
of the quantization steps needs to be relatively large. In 
that case, the resulting coarse quantization of the DCT 
coefficients introduces coding artifacts into the transmit- 
ted image, which include, e.g., speckle-like distortions 
near edges of objects appearing in a recovered image. 
[0003] Attempts have been made to reduce effects of 
the coding artifacts by postprocessing the recovered im- 
age. Since the artifacts typically comprise high frequen- 
cy components, such attempts invariably involve use of 
a postprocessor including a low-pass filter to fitter out 
those components in the recovered image. However, 
the design of such a postprocessor is normally deter- 
mined by experiment in an ad hoc manner. As a result, 
the quality of the postprocessed image is highly depend- 
ent upon how close the actual types of image transmit- 
ted and transmission rates used in the field are to those 
in the experiment. Consequently, use of the prior art 
postprocessor to improve the image quality is, at best, 
precarious as the performance achieved thereby may 
drastically vary from one set of field conditions to anoth- 
er. 

[0004] Accordingly, there exists a need for a depend- 
able technique for effectively reducing the effects of the 
coding artifacts in an image subject to an image coding 
process. 

Summary of the Invention 

[0005] We have recognized that due to the implemen- 
tation of the above image coding process, which in- 
volves quantization of block based frequency transform 
coefficients, e.g., DCT coefficients, concerning a trans- 
mitted image, the amplitude of each non-zero frequency 
component of the image, when received, cannot be 



smaller than a threshold value, which is a function of the 
quantization step size. That is, any non-zero frequency 
component having an amplitude smaller than the 
threshold value must be erroneously created, perhaps, 
s by aliasing which is incurred due to the block structure 
of the transform coefficients traversing a channel, which 
is band limited. 

[0006] Thus, in accordance with the invention, using 
a filter arrangement which is matched to the coding of 

10 the image involving the above quantization, the received 
image is transformed into a set of frequency compo- 
nents representative thereof. The quantization step size 
used in the quantization may vary from frequency com- 
ponent to frequency component. Each frequency com- 

75 ponent having a value below a threshold value corre- 
sponding thereto is removed from the set, where the 
threshold value is afunction of the quantization step size 
associated with the frequency component. Advanta- 
geously, the resulting image formed by the remaining 

20 frequency components is superior in quality to the re- 
ceived image, with the effects of the coding artifacts in 
the received image substantially reduced. In addition, 
the effectiveness of the inventive technique is independ- 
ent of the field conditions under which the image is com- 

25 municated. 

Brief Description of the Drawing 
[0007] In the drawing, 



30 



35 



40 



Fig. 1 is a block diagram of a communications sys- 
tem in accordance with the invention for communi- 
cating video images; 

Fig. 2 illustrates a postprocess performed by a cod- 
ing-matched filter arrangement in accordance with 
the invention to improve the quality of a recovered 
image in the system of Fig. 1; and 

Fig. 3 illustrates a video encoder using the coding- 
matched filter arrangement as a preprocessor in ac- 
cordance with the invention. 

Throughout this disclosure, unless otherwise stat- 
ed, like elements, components or sections in the fig- 
ures are denoted by the same numeral. 

Detailed Description 



so [0008] Fig. t illustrates communications system 100 
embodying the principles of the invention for communi- 
cating video images. As shown in Fig. 1, system 100 
comprises video source 105, video encoder 103, trans- 
mit electronics 131, receive electronics 151 and video 

55 decoder 150, all of conventional design, and coding- 
matched filter arrangement 180 in accordance with the 
invention. 

[0009] Video source 105 in a conventional manner 
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provides a bit stream representing images on a frame 
by frame basis. Each frame comprises LxM pixels, 
where L and M are selected integers greater than zero. 
For example, L = 720 and M = 480 in this instance. In 
response to such a bit stream, motion estimator 108, in 
a standard way, derives motion vectors indicating differ- 
ences between the current image frame and the previ- 
ous image frame from source 105. Based on such mo- 
tion vector information, and the previously transmitted 
frame provided by adder 110 to be described, motion 
compensator 113 generates a predicted version of the 
current frame to be transmitted. This predicted version 
is provided to adder 110 and subtracter 115. The latter 
subtracts the predicted version of the current frame from 
the original version thereof from source 105, thereby 
forming a prediction error signal. 
[0010] Discrete cosine transform (DCT) processor 
1 1 9 performs a well known DCT, which is a block based 
frequency transform, on the prediction error signal from 
subtracter 115. The resulting DCT coefficients are ar- 
ranged two-dimensiona!ly in blocks. These DCT coeffi- 
cients are quantized by quantizer 121 , entropy encoded 
by variable length encoder 124, and formatted by com- 
pression formatter 127, in accordance with the well 
known MPEG image compression scheme described in: 
D. LeGall, "MPEG, a Video Compression for Multimedia 
Applications," Transactions of ACM , vol. 34, no. 4, April 
1991, pp. 46-58. To properly carry out such an image 
compression scheme, the aforementioned motion vec- 
tor information is also provided by estimator 1 08 to com- 
pression formatter 127. 

[0011] It should be noted at this point that although 
quantizer 1 21 is a linear quantizer, the quantization step 
size used therein varies with the position of each DCT 
coefficient in a block to control the resulting quantization 
error corrupting the frequency component represented 
thereby. Thus, the quantization step size here is gener- 
ically represented by where i and j represent the row 
and column indexes of the DCT coefficient correspond- 
ing thereto in a block. It should also be noted that each 
Qjj varies from block to block and, thus, with time. 
[0012] Specifically, the value of each DCT coefficient 
input to quantizer 121 is divided by the corresponding 
Qij, thereby obtaining a quotient qt which may be zero, 
and a remainder R which may also be zero. R is then 
compared with a "quantization threshold" which is Qy/2 
in this example, if R > 0^2, the signal assumes a level 
of (qt + 1)Q;j for the coding purposes. Otherwise if R < 
Q rj /2, the signal assumes a level of (qt)Qjj. 
[0013] The information concerning the quantization 
step size is also provided to variable length encoder 
124 for transmission to video decoder 150. The output 
of compression formatter 1 27 may range from 1 Mb/s to 
20 Mb/s, and is transmitted by transmit electronics 
through a communication channel. 
[0014] The quantized DCT coefficients from quantizer 
121 are fed back to inverse quantizer 133 to reconstruct 
the transmitted frame ultimately recovered in decoder 



1 50. To that end, inverse quantizer 1 33 de-quantizes the 
quantized DCT coefficients, and thereby provides an 
approximate version of the original DCT coefficients. 
Based on such an approximate version, inverse DCT 

5 (I DCT) processor 1 35 recovers the prediction error sig- 
nal. Adder 110 adds the recovered prediction error sig- 
nal to the aforementioned predicted version of the trans- 
mitted frame from compensator 113, thereby recon- 
structing the transmitted frame, which is used by com- 

10 pensator 11 3 to predict the upcoming transmitted frame 
in a manner described before. 

[0015] Receive electronics 151 receives, through the 
aforementioned communication channel, a signal rep- 
resentative of a transmitted image frame from transmit 

1$ electronics 131. The received signal is processed by 
compression deformatter 1 53 in video decoder 150. De- 
formatter 1 53 performs the inverse function to compres- 
sion formatter 127 described before. Among other 
things, deformatter 127 recovers the aforementioned 

20 motion vector information, which is fed to motion com- 
pensator 1 63. The remaining output is further processed 
by variable length decoder 157 which performs the in- 
verse function to variable length encoder 1 24 described 
before. The output of decoder 1 57, which consists of the 

25 quantization step size information and quantized DCT 
coefficients, is provided to inverse quantizer 167. Where 
in some instances video encoder 103 may also provide 
field/frame information concerning the transmitted 
frame, the output of decoder 157 would also consist of 

30 such information. The quantization step size informa- 
tion, along with any field/frame information, is provided 
to coding-matched filter arrangement 1 80 described be- 
low. 

[0016] It should be noted at this point that motion com- 

35 pensator 163, inverse quantizer 167, IDCT processor 
173 and adder 170 in receiver 150 operate similarly to 
motion compensator 113, inverse quantizer 133, IDCT 
processor 135 and adder 110 in transmitter 103 to re- 
construct the transmitted frame. Thus, based on the re- 

40 ceived motion vector information, like compensator 113, 
compensator 163 provides a predicted version of the 
transmitted frame to adder 1 70. Based on the quantized 
DCT coefficients and the received quantization step 
size, like inverse quantizer 133, inverse quantizer 167 

^5 provides a de-quantized, approximate version of the co- 
efficients. Based on such a approximate version, like ID- 
CT processor 135, IDCT processor 173 recovers the 
prediction error signal. Adder 170 adds the prediction 
error signal to the predicted version of the transmitted 

50 frame from compensator 1 63 to recover the transmitted 
frame. The recovered frame is fed back to compensator 
163 to provide the predicted version of the upcoming 
transmitted frame. 

[0017] However, the recovered image frame from 
55 adder 1 70 is corrupted by coding artifacts resulting from 
the MPEG coding scheme used in video encoder 103. 
These artifacts are attributable to the DCT followed by 
the quantization in such a scheme. Specifically in trans- 
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mitter 103, the prediction error signal from subtracter 
115 is DCT transformed by processor 119 and then 
quantized by quantizer 1 21 . If the values of the DCT co- 
efficients from processor 1 1 9 are relatively small and the 
quantization step size is relatively large to effectively re- 
duce the transmission rate, the coefficients may all be 
quantized to zero. This leads to transmission of a zero 
prediction error signal to receiver 150, As a result, the 
predicted version of the transmitted frame from motion 
compensator 163 in receiver 150 would not be correct- 
ed, thereby causing "prediction coding" artifacts. In ad- 
dition, by virtue ot use of the DCT which is a block based 
frequency transform, well known "block" artifacts also 
emerge in the recovered image frame. 
[0018] In accordance with the invention, the recov- 
ered image frame from adder 170 is further processed 
by coding-matched filter arrangement 1 80 to reduce the 
effects of the aforementioned artifacts. Filter arrange- 
ment 180 is designed based on the coding scheme 
used, and in this instance is matched to that of the afore- 
mentioned MPEG scheme involving the DCT and quan- 
tization. Specifically, the recovered image frame from 
adder 170 is processed by DCT processor 183 in ar- 
rangement 180. Processor 183 in this instance performs 
a well known 8x8 DCT on the recovered image frame. 
However, it will be appreciated that a person skilled in 
the art may opt to perform other transforms, although 
less preferable, such as the Walsh-Hadamard transform 
or a one-dimensional transform, instead. 
[0019] In performing the 8 x 8 DCT, processor 1 83 first 
divides the recovered image frame into blocks of 8 pixels 
by 8 pixels. Each block is associated with one or more 
pixels in the frame. Fig. 2 illustrates one such block de- 
noted 205 which includes pixels A1 , B1 , .... and H8, and 
is associated with pixel D4 only. Processor 183 then 
transforms each block in accordance with the DCT For 
example, the transformed version of block 205 is illus- 
tratively block 207, which includes DCT coefficients a1 , 
b1, and h8 corresponding thereto. 
[0020] We have recognized that because of the im- 
plementation of the aforementioned coding scheme in- 
volving the quantized DCT transformation in encoder 
103, the smallest value of a nonzero DCT coefficient in 
block 207 cannot be smaller than the corresponding 
quantization threshold Cty2. Any non-zero DCT coeffi- 
cient in block 207 having an absolute value smaller than 
the corresponding QJ2 must be erroneously created, 
perhaps, by aliasing which is incurred due to the block 
structure of the DCT coefficients from DCT processor 
119 traversing the aforementioned communication 
channel, which is band limited. 
[0021] Thus, in accordance with the invention, in re- 
sponse to the aforementioned information concerning 
from video decoder 150, threshold controller 185 
truncates all DCT coefficients whose absolute values 
are below the corresponding QJ2 to zero, without losing 
any transmitted information. Assuming that all DCT co- 
efficients in block 207, except a few coefficients, namely, 



a1, b1, d, d1, e1, a2, b2, c2, d2, a3, b3 and a4, each 
have an absolute value smaller than the corresponding 
Qjj/2, controller 185 accordingly replaces all the DCT co- 
efficients except those few coefficients with a zero, 

s thereby yielding block 209. IDCT processor 187 then 
performs an inverse DCT on block 209, resulting in block 
211 consisting of pixels A1\ B1\ and H8\ However, 
the output of processor 187 in this instance consists of 
pixel D4' in block 21 1 corresponding to pixel D4 associ- 

io ated with block 205. This output replaces pixel D4 in the 
recovered frame from decoder 1 50. The process of Fig. 
2 is similarly repeated for each other block as divided 
by processor 183 for replacement of the pixel associat- 
ed therewith. The resulting frame containing the re- 

is placement pixels is advantageously superior in quality 
to the recovered frame, with the effects of the aforemen- 
tioned coding artifacts substantially reduced. 
[0022] The foregoing merely illustrates the principles 
of the invention. It will thus be appreciated that a person 

20 skilled in the art will be able to devise numerous arrange- 
ments which, although not explicitly shown or described 
herein, embody the invention. 

[0023] For example, in the disclosed embodiment, 
coding-matched filter arrangement 180 in accordance 

25 with the invention is used as a postprocessor in com- 
munication system 100. However, it will be appreciated 
that the inventive arrangement may be used as a pre- 
processor in the system as well. Fig. 3 illustrates one 
such system wherein coding- matched filter arrange- 

30 ment 380 similar to arrangement 1 80 processes the bit 
stream representative of image frames from video 
source 105 before video encoder 103. In that system, 
the threshold controller in arrangement 380 effectively 
removes all frequency components of each image frame 

3S whose amplitude is lower than the corresponding 
threshold Q^2. It should be noted that the majority of 
the frequency components in the image frame having 
such a low amplitude typically are those of high frequen- 
cies. The removal of the high frequency information 

40 which often represents, e.g., sharp object boundaries, 
does not significantly affect the image frame visually as 
human eyes naturally possess particular visual sensitiv- 
ity toward edges and boundaries in an image anyway. 
Transmission of the image frames preprocessed by ar- 

45 rangement 380 advantageously requires less band- 
width than their unprocessed counterparts, thereby al- 
lowing a finer quantization used in encoder 103 to fur- 
ther reduce the effects of the coding artifacts. Quantiza- 
tion step size controller 303 determines the value Qy for 

so the threshold controller in arrangement 380 and the 
quantizer in encoder 103 according to the bit rate al- 
lowed by the available transmission bandwidth, where 

varies inversely with such a bit rate. 
[0024] In addition, although the inventive coding- 

55 matched filter arrangement is used with an MPEG cod- 
ing scheme in the disclosed embodiment, the arrange- 
ment may also be matched to, and used with, other im- 
age coding schemes such as the MPEG-2 scheme, mo- 
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tion-JPEG scheme, JPEG scheme, etc. 
[0025] Finally, communications system 100 is dis- 
closed herein in a form in which various transmitter func- 
tions are performed by discrete functional blocks. How- 
ever, any one or more of these functions could equally 
well be embodied in an arrangement in which the func- 
tions of any one or more of those blocks or indeed, all 
of the functions thereof, are realized, for example, by 
one or more appropriately programmed processors. 



Claims 

1. A method for processing an image, the image being 
encoded by a coding process, which includes quan- 
tization of information concerning the image in ac- 
cordance with at least one quantization step size, 
the method comprising: 

transforming the image into a set of compo- 
nents representative thereof, each of the at 
least one quantization step size being associ- 
ated with a respective one of the components; 
and 

removing selected ones of the components 
from the set, each selected component having 
an absolute value below a threshold value cor- 
responding thereto, the threshold value being 
a function of the quantization step size associ- 
ated with the selected component 

2. The method of claim 1 wherein the image is encod- 
ed in accordance with an MPEG scheme. 

3. The method of claim 1 wherein the image is trans- 
formed in accordance with a block based frequency 
transform. 

4. The method of claim 3 wherein the block based fre- 
quency transform includes a DCT 

5. A method for processing at least one image for 
transmission, the image being represented by a se- 
lected set of frequency components, the method 
comprising: 

modifying the image, the modified image being 
represented by a second set of frequency com- 
ponents, each frequency component in the sec- 
ond set being included in the selected set; and 
quantizing selected information concerning the 
modified image in accordance with at least one 
quantization step size, each of the at least one 
quantization step size being associated with a 
respective one of the frequency components in 
the second set, each non-zero frequency com- 
ponent in the second set having an absolute 
value equal to at least a threshold value corre- 



sponding thereto, which is a function of the 
quantization step size associated with the non- 
zero frequency component. 

s 6. The method of claim 5 wherein the selected infor- 
mation includes prediction error information indicat- 
ing a difference between the modified image and a 
predicted version thereof. 

10 7. The method of claim 6 wherein the prediction error 
information includes DCT coefficients representa- 
tive thereof. 

8. The method of any of the preceding claims wherein 
*5 the quantizing is linear 

9. The method of any of the preceding claims wherein 
the at least one quantization step size varies with 
time. 

20 

10. The method of any of the preceding claims wherein 
the threshold value equals a half of the associated 
quantization step size. 

2S 11. A method for receiving information concerning at 
least one image, the method comprising: 

recovering the image; 

de-quantizing at least part of the received infor- 
mation in accordance with at least one quanti- 
zation step size; and 

modifying the recovered image by removing 
therefrom selected frequency components of 
the recovered image, each selected frequency 
component being associated with a respective 
one of the at least one quantization step size, 
each selected frequency component having an 
absolute value below a threshold value corre- 
sponding thereto, the threshold value being a 
function of the quantization step size associat- 
ed with the selected frequency component 

12. The method of claim 11 wherein the at least part of 
the received information includes prediction error 
information indicating a difference between the im- 
age and a predicted version thereof. 

13. The method of claim 11 wherein the selected fre- 
quency components are represented by DCT coef- 

so ficients. 

14. The method of claim 11 wherein the recovered im- 
age includes a plurality of pixels, the method further 
comprising dividing the recovered image into a plu- 

55 rality of blocks, each block containing a predeter- 
mined number of pixels. 

15. The method of claim 14 wherein each block is as- 
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sociated with one or more of the pixels in the block. 

16. The method of claim 1 5 further comprising process- 
ing each block to generate one or more pixels to 
replace the one or more of the pixels associated s 
with the block, respectively. 

17. The method of claim 16 wherein the one or more 
pixels generated constitute the modified recovered 
image. 10 

18. Apparatus comprising means arranged to carry out 
a method as claimed in any of the preceding claims. 

19. A computer program product directly loadable into 
the internal memory of a digital computer compris- 
ing software code for performing a method as 
claimed in any of claims 1 to 17 when said product 
is run on a computer. 

20. A computer program product stored on a computer 
usable medium, comprising computer readable pro- 
gram means for causing a computer to perform a 
method as claimed in any of claims 1 to 17. 
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FIG. 2 
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FIG. 3 
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